Unified Bayesian theory of sparse linear regression with nuisance parameters
نویسندگان
چکیده
We study frequentist asymptotic properties of Bayesian procedures for high-dimensional Gaussian sparse regression when unknown nuisance parameters are involved. Nuisance can be finite-, high-, or infinite-dimensional. A mixture point masses at zero and continuous distributions is used the prior distribution on coefficients, appropriate parameters. The optimal posterior contraction hampered by presence parameters, also examined discussed. It shown that procedure yields strong model selection consistency. Bernstein-von Mises-type theorem coefficients obtained uncertainty quantification through credible sets with guaranteed coverage. Asymptotic numerous examples investigated using theory developed in this study.
منابع مشابه
On the Unified Method with Nuisance Parameters
In this paper we consider the problem of constructing confidence intervals in the presence of nuisance parameters. We discuss a generalization of the unified method of Feldman and Cousins (1998) with nuisance parameters. We demonstrate our method with several examples that arise frequently in High Energy Physics and Astronomy. We also discuss the hybrid resampling method of Chuang and Lai (1998...
متن کاملOn a unified framework for linear nuisance parameters
Estimation problems in the presence of deterministic linear nuisance parameters arise in a variety of fields. To cope with those, three common methods are widely considered: (1) jointly estimating the parameters of interest and the nuisance parameters; (2) projecting out the nuisance parameters; (3) selecting a reference and then taking differences between the reference and the observations, wh...
متن کاملRobust Estimation in Linear Regression with Molticollinearity and Sparse Models
One of the factors affecting the statistical analysis of the data is the presence of outliers. The methods which are not affected by the outliers are called robust methods. Robust regression methods are robust estimation methods of regression model parameters in the presence of outliers. Besides outliers, the linear dependency of regressor variables, which is called multicollinearity...
متن کاملBayesian Sparse Linear Regression with Unknown Symmetric Error
We study full Bayesian procedures for sparse linear regression when errors have a symmetric but otherwise unknown distribution. The unknown error distribution is endowed with a symmetrized Dirichlet process mixture of Gaussians. For the prior on regression coefficients, a mixture of point masses at zero and continuous distributions is considered. We study behavior of the posterior with divergin...
متن کاملAn Empirical Analysis of Algorithms for Bayesian Sparse Linear Regression
Two conceptually similar algorithms for performing sparse linear regression under a Bayesian framework are presented. A novel implementation of a third algorithm is adapted from the log-linear regression task and applied to the linear regression model. The algorithms differ in terms of the search strategy used to explore the space of possible active variables; one uses a greedy approach, while ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2021
ISSN: ['1935-7524']
DOI: https://doi.org/10.1214/21-ejs1855